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objects through the zone by detecting interruptions of the beams. 

8. An apparatus as claimed in claim 6 or claim 7, characterised in that it includes alarm generating means 
(38) operable to generate an alarm when a beam is interrupted and in that it includes a multiplexer (22) 
operable to pass input signals received from a plurality of different zones to be monitored to a single 
processor (26,36). 

9. An apparatus as claimed in any one of the preceding claims 6 to 8, characterised in that it includes a 
neural network (30) comprising a plurality of interconnected neural nodes (52.1,52.2,52.3; 
54.1,54.2,54.3,54.4; 56.1,56.2), and in that it includes biassing means (58,60) operable to bias signals 
received from the nodes with different interconnection weights thereby to vary the effect of signals 
received from the various nodes. 

10. An apparatus as claimed in any one of the preceding claims 8 to 12, characterised in that it includes 
classification means (26) operable to classify interruptions of the beams into a plurality of classes 
representative of likely causes of the interruptions, and display means (39) operable to display an 
indication of the class derived by the classification means. 
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quantified to at most a few possible values to provide for partial obscuration of the beams 14. The number 
of outputs is limited to an alarm signal plus one of a few possible classifications. It will be appreciated that 
the response provided by the apparatus need not be instantaneous as a reaction time of a few hundred 
milliseconds to several seconds is acceptable in almost all cases. 

5 The applicant believes that because an array of active optical beam sensors with a pattern recognition 

algorithm are combined, the false alarm rate compared with that of a conventional rule-based beam security 
system can be drastically reduced. 

The invention illustrated facilitates the optimal utilisation of data gathered by an optical beam fence in 
deciding on the issuing and classification of alarm messages. It furthermore allows the user to eliminate 

w false alarms produced by spurious causes like power-line glitches, and enables a system based on the 
architecture described to degrade gracefully when the beam array is impaired by failure or obstruction. 
Central processing of data by the controller 36 also eliminates duplication of logic services at each sensing 
means 10.1, 10.2 and 10.3 allowing a high level of system integrity to be maintained, since beam status 
information can be passed to the controller 36 together with data relating to interruption of the beams 14. 

75 Classification is not done by a rule-based expert system and does not use human value judgements, since 
real-world data are used as the only inputs during training of the neural network 30. Although training is 
normally done on a personal computer or workstation, the classification can be implemented on a single- 
chip microprocessor. 

20 Claims 

1. A method of monitoring a zone characterised in that it includes transmitting a plurality of beams (14) 
between at least two locations (12.1,12.2) defining extremities of the zone, detecting interruptions of the 
beams (14) caused by an object moving between the two locations (12.1,12.2), generating a graph 

25 (40.1,40.2; 42.1,42.2; 44.1.44.2; 46.1,46.2) of the interruptions relative to time, and comparing the graph 

generated with a set of preselected graphs representative of known objects. 

2. A method as claimed in claim 1, characterised in that the graph generated is compared with the 
preselected graphs using image recognition techniques. 

30 

3. A method as claimed in claim 1 or claim 2, characterised in that interruptions of the beams (14) are 
monitored continuously and in that each interruption, restoration or partial occlusion of any beam is 
stored together with the time of occurrence and in that the graph of interruptions generated in the form 
of a temporal profile is translated into a physical outline profile. 

35 

4. A method as claimed in any one of the preceding claims, characterised in that it includes pre- 
processing the graph generated and then submitting data forming the graph in a suitable format to a 
pattern recognition algorithm to permit classification of the cause of the interruption into various classes 
and displaying an indicator representative of the probable cause in terms of the classification. 

40 

5. A method as claimed in any one of the preceding claims, characterised in that the preselected graphs 
are stored in a neural network (30) comprising a plurality of neural nodes (52.1,52.2,52.3; 
54.1,54.2,54.3,54.4; 56.1,56.2) and in that signals received from different nodes are selectively biased 
by interconnection weights (58,60) thereby to vary the effect of signals received from different nodes. 

45 

6. A monitoring apparatus for monitoring a zone, characterised in that it includes 

storage means (34) for storing a set of preselected graphic representations of known objects, 
sensing means for sensing interruptions of a plurality of beams (14); 

graph generation means (24) responsive to the sensing means and operable to generate a 
so graphical representation (40.1,40.2; 42.1,42.2; 44.1.44.2; 46.1,46.2) with respect to time of the interrup- 

tions sensed by the sensing means; and 

comparing means (32) operable to compare the graphical representation generated by the graph 
generation means (24) with the graphical representations stored in the storage means (34). 

55 7. An apparatus as claimed in claim 6, characterised in that the sensing means includes an array of at 
least two optical beams (14) transmitted in spaced relationship from at least one location (12.1) at one 
extremity of the zone to be monitored, and in that another location (12.2) at an opposite extremity of the 
zone has detector elements responsive to the optical beams (14) and operable to detect movement of 
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label 12 3 4 

5 1: 72 0 0 0 

2: 0 26 0 0 

3: 0 0 50 2 

w 4: 0 0 4 105 

Table 1 

75 

It can be seen in Table 1 that the network has no difficulty in distinguishing the first two classes, ie the 
walking humans and the motor vehicles, from the others and from each other. As can be expected it was 
somewhat more difficult to distinguish a crawling human (class 3) from a dog (class 4), with 2 out of 52 
humans being classified as dogs and 4 out of 109 dogs being classified as humans. This gives however a 

20 better than 96% accuracy on these two classes, with an overall accuracy of 97.68%. 

Table 2 below shows the network weights which can be used for a two-input, two-output neural network 
with three intermediate neurons, partly trained on an exclusive-or problem, ie similar to that shown in Figure 
3 except that there are only three intermediate neurons 54.1 to 54.3 instead of the four neurons 54.1 to 54.4 
shown in Figure 3. This problem has two classes (1 and 2) and two inputs. Inputs (0,0) and (1,1) fall in class 

25 1, while the other two, (0,1) and (1,0), constitute class 2. It will be seen that Table 2 shows the network as 
having three inputs. This is because one input neuron is added, with constant activation of 1, to enable a 
variable threshold to be realized during training. 



30 



Weights: 

From input neurons 52.1, 52.2 and 52.3 to 
intermediate neurons 54.1 to 54.3 

To neuron 54 . l: 

35 -9.432522 10.613865 -7.209504 

To neuron 54.2: 

6.569661 -1.950402 0.972534 

40 To neuron 54.3: 

1.260390 -6.663808 3.632652 

From intermediate neurons 54.1 to 54.3 to 
output neurons 56.1 and 56.2 

45 To neuron 56.1: 

1.109862 -0.393785 0.336293 

To neuron 56.2: 

50 -1.055528 0.674493 0.387741 

Table 2 

55 

The invention illustrated provides a monitoring apparatus which is simple because the number of 
primary inputs provided by the sensing means 10 is small. Two to eight beams 14 can be used in the 
sensing means of Figure 1. Also, the inputs are binary, ie the beam 14 is either broken or is not, or is 
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moments of the object. Two-dimensional moments are defined as: 

oo oo 



In this case both i and j are in the range [0...3]. After training, preselected network weights are 

io transferred to the weight storage means 34 which feeds the neural network 30. Typical outputs from the 
neural network are shown in Figure 4 and can be presented to an operator via the display device and/or 
printer 39, combined with an audio warning signal from the alarm means 38. 

Each change in beam status is logged with the time of occurrence, and the graphical representation is 
built up by normalizing the duration of the activity. The duration can be displayed (in milliseconds) directly 

75 above the displayed event. 

Figure 4 shows a typical output display from the neural network 30 after classification when presented 
with various inputs from various classes of objects. Raw data of different persons walking through the 
sensing means 10 is shown in the graphical representations 40.1, 40.2 and 40.3; of a motor vehicle passing 
the sensing means 10 by the graphical representations 42.1 and 42.2; of a person crawling through the 

20 sensing means 10 by the graphical representations 44.1 and 44.2; and of a dog walking through the sensing 
means 10 by the graphical representations 46.1 and 46.2. These graphical representations are compared 
with preselected graphs (not shown) stored in the storage means 34 of Figure 2. In each case, directly to 
the right of the graphical representations of the raw data, an icon 48 denoting the class decided upon by the 
monitoring apparatus is shown so as to enable an operator easily to identify the object sensed. 

25 A simplified form of neural network 30 is shown in Figure 3. The network 30 has three input nodes or 

neurons 52.1, 52.2 and 52.3, an intermediate series of neurons 54.1, 54.2, 54.3 and 54.4, and two output 
neurons 56.1 and 56.2. The neurons are interconnected by weighted lines 58 and 60 whereby different 
weights can be applied from a preceding neuron to influence the output of a subsequent neuron when data 
are presented to the input neurons 52.1, 52.2 and 52.3. 

30 Thus data received by say the input neuron 52.1 will be weighted by the weighted lines 58 and 
influence the output of the intermediate neurons 54.1 to 54.4 to present a signal which is itself weighted by 
the weighted lines 60 and which is then presented to the output neurons 56.1 and 56.2. A neuron can thus 
be defined as a node with a number of weighted inputs which are summed together and passed through 
some form of non-linear process. The most common non-linearity used is the sigmoid function: 

35 

S(x) = 1— 

40 

which maps the input to an output between 0 and 1. The values of inputs to the nodes 52.1 to 52.3 are 
multiplied by appropriate selected weights on lines 58 and summed in the neurons 54.1 to 54.4. The 
outputs of these neurons 54.1 to 54.4 are then passed in the same way to the next layer (in this instance 
the output neurons 56.1 and 56.2, although there can be more than one intermediate layer of neurons). The 

45 classification is indicated by the output neuron 56.1 or 56.2 with the highest output value. Obviously the 
performance of the network hinges on the values of the interconnection weights on lines 58 and 60. 
Adjustment of these weights is an optimization process which can be done in several ways (mostly variants 
of gradient-search routines) of which the conjugate-gradient algorithm is one of the most efficient. 

Table 1 below illustrates a matrix associated with a neural network trained by a conjugate gradient 

50 training algorithm to distinguish between walking humans (class 1), motor vehicles (class 2), crawling 
humans (class 3) and dogs (class 4). In Table 1, the rows correspond to true classes and the columns to 
the classes assigned to sample objects by the neural network 30. A network with seventeen input neurons, 
twelve intermediate neurons and four output neurons was used. The seventeen input neurons were chosen 
to correspond to the first sixteen two-dimensional moments of the raw input graphical representations plus 

55 the total duration of the event causing interruption of the beams 14. Four output neurons were used to 
denote the four classes the network was trained to distinguish. 
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detection of the direction of movement of the object. The beams may be infra red beams, laser beams, or 
any other optical medium. 

The apparatus may include alarm generating means operable to generate an alarm when a beam is 
interrupted. 

5 If a plurality of different zones are to be monitored, inputs from the different zones may be fed via a 

multiplexer to a single processor. 

In order to improve operation of the classifying means in its operational environment, as much as 
possible pre-classified data relating to beam interruptions of known objects are gathered, care being 
exercised that it represents as far as possible all manifestations of all types of activity expected to cause 
w interruption of the beams. This data is then used as criteria to train the neural network. Selection of the 
criteria and capturing of known beam interruption causes may be done as an off-line process and need be 
done only once for a particular installation on a separate computer. 

The interconnection weights used in the neural network can be stored in a replaceable permanent 
memory, such as ROM, PROM, EPROM, EEPROM, and so on, for easy and quick upgrading of the 
15 algorithm if, based on experience in use of the apparatus in a particular location or generally, circumstances 
require this or if more accurate data become available. 

Since a correctly trained and a correctly sized network is capable of generalising, fundamental rules 
distinguishing different types of activity from each other are, in effect, discovered by the network itself 
during training. It is therefore important that the training data is representative. 
20 An embodiment of the invention is now described, by way of example, with reference to the 

accompanying drawings, in which: 

Figure 1 is a side view of one form of sensing means used with a monitoring apparatus in accordance 
with the invention; 

Figure 2 is a schematic block diagram of the monitoring apparatus; 
25 Figure 3 is a schematic diagram of a simple neural network which can be used in the monitoring 
apparatus; and 

Figure 4 shows schematic diagrams of various outputs of the neural network resulting from interruptions 
of the sensing means of Figure 1 . 
Referring to Figure 1, reference numeral 10 generally indicates a typical form of sensing means used to 

30 monitor activities occurring in a zone to be monitored. The sensing means 10 includes a pair of poles 12.1 
and 12.2 anchored in the ground at extremities of the zone. The poles 12.1 and 12.2 can be mounted 
relatively close together, eg about 2 metres apart, or up to 1000 metres or more apart dependent upon the 
zone to be monitored. In the embodiment illustrated four vertically spaced optical beams 14, which are 
preferably infra red beams, are transmitted between the poles 12.1 and 12.2 by suitable light emitters (not 

35 shown) contained within one or both of the poles 12.1 and 12.2. Each beam 14 is received by a suitable 
light detector (not shown) so that whenever one of the beams is interrupted, this can be detected. 

Referring now to Figure 2, a monitoring apparatus 20 is shown connected to three of the sensing means 
10.1, 10.2 and 10.3 of Figure 1. Obviously, more or less than three sensing means may be used. The light 
detectors of the sensing means are scanned continuously so as to detect the presence or absence of light 

40 received from the light emitters at any instant of time. Raw binary data received from the light detectors in 
each sensing means 10.1, 10.2 and 10.3, indicative of whether or not a particular beam is broken or not, are 
generated and fed via a multiplexer 22 to graphical generation means 24 which generates a graphical 
representation of interruptions of the light beams 14 with respect to time. The raw data is also simulta- 
neously stored in raw data storage means 25 so that the raw data can be made available at any later stage. 

45 The graphical representation is then fed to a classifier 26. The classifier 26 includes a pre-processor 28, 
a neural network 30 and comparing means 32. The graphical representation is compared with preselected 
graphical representations stored in weighted storage means 34. The output of the comparing means 32 is 
then fed to a controller 36 which may be in the form of a computer. The controller 36 reacts to the output of 
the classifier 26 and in appropriate circumstances energises alarm means 38. The controller also is 

so connected to a printer and/or a display device 39 to enable the classified graphical representation to be 
printed and/or displayed. 

In order to train the classifier 26 to detect and classify expected known objects, a training workstation or 
computer 35 is used. 

During training, data relating to known objects are classified and pre-processed and stored in the 
55 weighted storage means 34 thereby to train the classifier 26 to distinguish between the preselected classes 
of expected objects. In a preferred embodiment, the neural network 30 is presented with seventeen inputs 
or features relating to any particular preselected object. The seventeen inputs include a signal representa- 
tive of the duration of any particular event and signals representative of the first sixteen two-dimensional 

3 
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© Monitoring system. 



© A monitoring apparatus and a method of monitoring a zone are disclosed. A plurality of beams (14) are 
transmitted between at least two locations (12.2,12.2) defining extremities of the zone. Interruptions of the beams 
(14) caused by an object moving between the two locations are detected by sensing means and a graph of the 
interruptions relative to time is generated. The graph generated is compared with a set of preselected graphs 
representative of known objects stored in storage means (34). 
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THIS INVENTION relates to a monitoring system. It relates in particular to a monitoring system intended 
for use with a security system, eg for monitoring or controlling admission into an area. 

In conventional security systems in which one or more beams, such as optical beams, are transmitted 
between two or more locations, eg spanning the perimeter of a security area, problems can arise as a result 

5 of false alarms caused by natural objects, such as birds, dogs, waving branches of trees, and the like, 
interrupting the beams. If the security area is large, monitoring of such false alarms can be time consuming 
in that it is normally necessary for a person monitoring the area physically to inspect the region in which the 
beam was interrupted unless expensive cameras are installed at various locations. It is an object of the 
invention to offer a solution to this problem. 

w In accordance with the invention a method of monitoring a zone includes transmitting a plurality of 

beams between at least two locations defining extremities of the zone, detecting interruptions of the beams 
caused by an object moving between the two locations, generating a graph of the interruptions relative to 
time, and comparing the graph generated with a set of preselected graphs representative of known objects. 
Further according to the invention there is provided a monitoring apparatus for monitoring a zone and 

75 which includes 

storage means for storing a set of preselected graphic representations of known objects, 
sensing means for sensing interruptions of a plurality of beams; 

graph generation means responsive to the sensing means and operable to generate a graphical 
representation with respect to time of the interruptions sensed by the sensing means; and 
20 comparing means operable to compare the graphical representation generated by the graph generation 

means with the graphical representations stored in the storage means. 

The graph generated may be compared with the preselected graphs using image recognition tech- 
niques. 

Interruptions of the beams may be monitored continuously and each interruption, restoration or partial 

25 occlusion of any beam may be stored together with the time of occurrence. 

The graph of interruptions generated in the form of a temporal profile may be translated into a physical 
outline profile. The resolution of the profile would be dependent upon the number of beams and the spacing 
between the beams, as well as the speed of the object interrupting the beams. 

The graph generated may be subjected to pre-processing and data forming the graph may then be 

30 submitted in a suitable format to a pattern recognition algorithm to permit classification of the object. Pre- 
processing may include extraction of image parameters, eg. moments, Zernike moments or Fourier 
coefficients, which can then be fed to a neural network. The cause of the interruption may be classified into 
various classes and an indicator representative of the probable cause in terms of the classification may be 
displayed by display means. 

35 The preselected graphs may be stored in the neural network. The neural network may comprise a 
plurality of interconnected neural nodes, and signals received from the various nodes may be biased with 
different interconnection weights thereby to vary the effect of signals received from the various nodes. This 
can minimise errors. Training of the neural network and setting up of the interconnection weights is a 
computationally intensive process normally done on a powerful computer or workstation. 

40 The final network weights reached after training of the neural network may then be made available to an 
operational or embedded computer, which is then used to classify the object. This is a relatively simple 
process, with one multiplication and one addition per interconnection between each neural node of the 
neural network. The operational computer need not be a very powerful computer, provided the size of the 
network is not extravagant. The output of the network provides a real-time classification of the status of 

45 interruption of the beams. 

Although statistical methods can be used to ascertain the defining features of a specific object thereby 
to classify the object, the applicant has found that the most successful general pattern recognition algorithm 
(excluding the human brain) can be achieved by the neural network. In the neural network, the graphic 
representations of known objects may be used to train the neural network to achieve optimal segmentation 

50 of N dimensional space defined by N image parameters. 

A relatively small neural network may then be used for classification. 

The sensing means may include an array of at least two optical beams transmitted in spaced 
relationship from one or more locations arranged at opposite extremities of the zone to be monitored, eg 
from a pair of poles or the like at extremities of the zone. Detector elements responsive to the optical 
55 beams and operable to detect movement of objects through the zone by detecting interruptions of the 
beams may be housed in one or both of the pair of poles. The optical beams may be transmitted in 
vertically spaced relationship but may also be transmitted in horizontally spaced relationship or at an angle 
between the vertical and the horizontal. Suitable arrangement of the spacing of the beams can facilitate 
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